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CLAIMS 

We claim: 

1. In an audio processing tool, a method comprising: 

processing plural frames for an audio signal, wherein the plural frames include a 
5 mix of one or more intra frames and one or more predicted frames, wherein at least one 
of the one or more predicted frames uses long-term prediction from outside of the 
predicted frame, and wherein each of the one or more intra frames uses no long-term 
prediction from outside of the intra frame; and 

outputting a result. 

10 

2. The method of claim 1 wherein the audio processing tool is a real-time 
speech encoder that uses linear prediction and the result is encoded speech. 

3. The method of claim 1 further comprising adjusting intra frame usage during 
15 encoding to change intra frame rate and/or locations. 

4. The method of claim 1 wherein the audio processing tool is a real-time 
speech decoder that uses linear prediction and the result is reconstructed speech. 

20 5. The method of claim 1 wherein at least one of the one or more intra frames 

uses short-term prediction from outside of the intra frame in linear prediction filtering. 

6. The method of claim 1 wherein the processing comprises, for each of the one 
or more intra frames, reconstructing an excitation using one or more excitation 

25 codebook index values but no pitch values introducing long-term prediction. 

7. The method of claim 1 wherein the one or more predicted frames each 
include plural predicted sub-frames and no intra sub-frames. 

30 8. The method of claim 1 wherein the one or more intra frames each include 

plural intra sub-frames and no predicted sub-frames. 
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9. The method of claim 1 wherein at least one of the intra frames includes at 
least one intra sub-frame and at least one predicted sub-frame that uses prediction 
within the intra frame. 

5 

10. The method of claim 1 wherein each of the one or more intra frames and the 
one or more predicted frames are sub-classes of voiced frames. 

1 1 . The method of claim 1 wherein grouping of plural consecutive intra frames 
10 prevents prediction over the intra frame grouping. 

12. The method of claim 1 further comprising, for the one or more predicted 
frames but not the one or more intra frames, interpolating linear prediction coefficient 
information across frames. 

15 

13. The method of claim 12 wherein the information comprises LSP values. 

14. The method of claim 1 wherein frame-level type signaling information 
differentiates the one or more intra frames from the one or more predicted frames. 

20 

15. The method of claim 1 wherein each of the plural frames is encapsulated in 
a single packet. 

16. A computer-readable medium storing computer-executable instructions for 
25 causing a computer system programmed thereby to perform the method of claim 1 . 

17. In an audio encoder, a method of encoding plural frames for an audio signal, 
the method comprising: 

encoding plural predicted frames of the plural frames; and 
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encoding plural intra frames of the plural frames, wherein the encoder sets intra 
frame usage and inserts the plural intra frames among the plural predicted frames 
according to the intra frame usage. 

5 18. The method of claim 17 wherein the encoder sets an intra frame rate 

indicating a regular interval between intra frames. 

19. The method of claim 1 8 wherein the encoder adjusts the intra frame rate 
during encoding based at least in part on network loss rate and/or decoder loss rate. 

10 

20. The method of claim 17 wherein the encoder selectively inserts intra frames 
to be quick recovery locations. 

21 . The method of claim 17 wherein the audio encoder is a real-time speech 
1 5 encoder that uses linear prediction. 

22. A computer-readable medium storing computer-executable instructions for 
causing a computer system programmed thereby to perform the method of claim 17. 

20 23. In an audio decoder, a method comprising: 

decoding plural frames for an audio signal, wherein the plural frames include 
one or more intra frames and one or more predicted frames, and wherein frame-level 
type signaling information differentiates the one or more intra frames from the one or 
more predicted frames in a bitstream; and 

25 outputting decoded information. 

24. The method of claim 23 wherein the frame-level type signaling information 
is a single bit per frame. 

30 25. The method of claim 23 wherein the frame-level type signaling information 

uses multiple bits per frame. 
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26. The method of claim 23 wherein the audio decoder is a real-time speech 
decoder that uses linear prediction. 

5 27. A computer-readable medium storing computer-executable instructions for 

causing a computer system programmed thereby to perform the method of claim 23. 

28. In a speech processing tool, a method comprising: 

processing a frame for a speech signal, including processing primary encoded 
10 information for the frame and one or more versions of forward error correction 

information for the frame, wherein the primary encoded information comprises plural 
parameter values, and wherein each of the one or more versions of forward error 
correction information comprises a subset of the plural parameter values selected based 
at least in part on an estimate of extra available bits; and 
1 5 outputting a result. 

29. The method of claim 28 wherein the subset is also selected based at least in 
part on network loss rate or decoder loss rate 

20 30. The method of claim 28 wherein the subset is also selected based at least in 

part on frame class. 

31. The method of claim 28 wherein the primary encoded information is packed 
into a single packet with forward error correction information for a preceding frame. 

25 

32. The method of claim 28 wherein the speech processing tool is a real-time 
speech encoder that uses linear prediction, wherein the result is encoded speech, and 
wherein the plural parameter values are plural linear prediction parameter values. 
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33. The method of claim 28 wherein the speech processing tool is a real-time 
speech decoder that uses linear prediction, wherein the result is reconstructed speech, 
and wherein the plural parameter values are plural linear prediction parameter values. 

5 34. A computer-readable medium storing computer-executable instructions for 

causing a computer system programmed thereby to perform the method of claim 28. 

35. In a speech processing tool, a method comprising: 
processing a frame for a speech signal, including processing primary encoded 

information for the frame and plural versions of forward error correction information 
for the frame, wherein the primary encoded information comprises plural parameter 
values, and wherein each of the plural versions of forward error correction information 
comprises a different subset of the plural parameter values for the frame; and 
outputting a result. 

36. The method of claim 35 wherein each of the plural versions of forward error 
correction information is packed into a different packet for network transmission. 

37. The method of claim 35 wherein the speech processing tool is a real-time 
20 speech encoder that uses linear prediction, wherein the result is encoded speech, and 

wherein the plural parameter values are plural linear prediction parameter values. 

38. The method of claim 35 wherein the speech processing tool is a real-time 
speech decoder that uses linear prediction, wherein the result is reconstructed speech, 

25 and wherein the plural parameter values are plural linear prediction parameter values. 

39. A computer-readable medium storing computer-executable instructions for 
causing a computer system programmed thereby to perform the method of claim 35. 



10 
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30 



40. In an audio processing tool, a method comprising: 
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processing encoded information for an audio signal, wherein the encoded 
information includes forward error correction information for a first frame and primary 
encoded information for a second frame, and wherein at least some of the forward error 
correction information for the first frame is predictively encoded relative to the primary 
5 encoded information for the second frame; and 

outputting a result. 



41. The method of claim 40 wherein a single packet includes the forward error 
10 correction information for the first frame and the primary encoded information for the 

second frame. 

42. The method of claim 41 wherein the single packet further includes forward 
error correction information for one or more other frames. 

15 

43. The method of claim 40 wherein the second frame is the current frame and 
the first frame is a preceding frame. 

44. The method of claim 40 wherein the forward error correction information 
20 for the first frame comprises linear prediction coefficient information predicted from 

corresponding coefficient information for the second frame. 

45. The method of claim 44 wherein the forward error correction information 
for the first frame comprises one or more excitation parameters predicted from 

25 corresponding excitation parameters for the second frame. 

46. The method of claim 40 wherein the audio processing tool is a real-time 
speech encoder and the result is encoded speech. 



30 47. The method of claim 40 wherein the audio processing tool is a real-time 

speech decoder and the result is reconstructed speech. 



KBR/kbr 3382-67640 MS 305433.01 03/31/04 EXPRESS MAIL LABEL NO. EV331580820US 

DATE OF DEPOSIT: March 31, 2004 

-42- 

48. A computer-readable medium storing computer-executable instructions for 
causing a computer system programmed thereby to perform the method of claim 40. 

5 49. In a real-time speech encoder that uses linear prediction, a method 

comprising: 

encoding a speech signal as plural linear prediction parameters, including 
adjusting bitrate and quality for a current frame of the speech signal based at least in 
part on (a) complexity of the current frame, (b) complexity and/or rate of at least some 
10 surrounding segments of the speech signal, (c) desired operating rate, (d) currently 

available network bandwidth, and (e) current network congestion or noise conditions or 
decoder feedback; and 

outputting encoded speech. 

15 50. The method of claim 49 wherein the encoder performs the adjusting bitrate 

and quality on a frame-by- frame basis. 

5 1 . A computer-readable medium storing computer-executable instructions for 
causing a computer system programmed thereby to perform the method of claim 49. 

20 

52. In an encoder-side audio processing tool, a method of encoding one or more 
frames of an audio signal, the method comprising: 

estimating a number of extra available bits for a segment of the audio signal 
after basic encoding; and 
25 using at least some of the extra available bits for adaptive forward error 

correction. 

53. The method of claim 52 wherein the audio processing tool is adapted to 
encode speech in real-time using linear prediction. 

30 
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54. The method of claim 52 wherein the estimating is based at least in part upon 
currently available network bandwidth and complexity of the audio signal. 

55. The method of claim 52 further comprising: 

setting an allocation between forward error correction improvement and primary 
encoding quality improvement; and 

applying the extra available bits according to the allocation for the forward error 
correction and/or primary encoding. 

56. The method of claim 55 wherein the encoder adjusts the allocation during 
encoding is based at least in part on network loss rate or decoder loss rate. 

57. The method of claim 55 wherein the audio processing tool improves error 
resiliency by increasing intra frame usage. 

58. The method of claim 55 wherein the audio processing tool improves forward 
error correction using fuller parameter sets for forward error correction information. 

59. A computer-readable medium storing computer-executable instructions for 
causing a computer system programmed thereby to perform the method of claim 52. 

60. In a real-time speech encoder that uses linear prediction, a method 
comprising: 

encoding a speech signal as plural linear prediction parameters, including 
adjusting bitrate and quality for a current segment of the speech signal based at least in 
part on a quality smoothness criteria for a transition between a previous segment and the 
current segment; and 

outputting encoded speech. 
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61. The method of claim 60 wherein the adjustment is also based at least in part 
on desired operating rate, speech class, complexity of the current segment, and 
complexity or bitrate of the previous segment. 

62. The method of claim 61 wherein the adjustment is also based at least in part 
on network bandwidth, network loss rate, or decoder loss rate. 

63. A computer-readable medium storing computer-executable instructions for 
causing a computer system programmed thereby to perform the method of claim 60. 

64. In an audio processing tool, a method comprising: 

processing a frame for an audio signal, including processing first information 
that represents the frame as a predicted frame or intra frame, and further including 
processing second information that represents the frame as an intra frame; and 

outputting a result. 

65. The method of claim 64 wherein the first information is for primary 
encoding and the second information is for forward error correction. 

66. The method of claim 64 wherein the second information is for primary 
encoding and the first information is for forward error correction. 

67. The method of claim 64 wherein the predicted frame representation uses 
long-term prediction from outside of the frame, and wherein the intra frame 
representation uses no long-term prediction from outside of the frame. 

68. The method of claim 64 wherein the audio processing tool is a real-time 
speech encoder that uses linear prediction, and wherein the result is encoded speech. 
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69. The method of claim 64 wherein the audio processing tool is a real-time 
speech decoder that uses linear prediction, and wherein the result is reconstructed 
speech. 

5 70. A computer-readable medium storing computer-executable instructions for 

causing a computer system programmed thereby to perform the method of claim 64. 



